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ADVERTISEMENT RESPONSE SYSTEM 

FIELD OF THE INVENTION 

This Invention relates to specific technologies and Implementations of a 
new telephonic communication system which enables direct callbacit to facilitate 
consumer response to radio, TV or Internet advertising. 

BACKGROUND OF THE INVENTION 

Consumers have become accustomed to using various forms of 
electronic equipment, such as stereos and televisions, to receive content and 
information which Is broadcast over the ainwaves and/or wire. With the wide 
proliferation of cable, and the Increasing growth of digital cable, most homes 
can receive audio, television and movie programming over cable for viewing on 
a television receiver. While cable service providers Indeed possess the 
infrastructure for distributing broadcast audio and video content, it is not 
normally considered by the eonsurher as being useable f&r providing additional 
tele<:|>mmunication ftinctbnallty. 

I Cdiltlmpprary hdifte televis^^ 
home, today distribifted services may Include prqvidih| 'str^Hlria iati' in 
conjunction with video programming. For example, while wfatchlrig a sporfing 
mt% specific data on the players and teams caj) bf :tfafj|^gf d^;|^^^^^ 
alongside the actual live video of the broadcast event. Additionally, 'data 
streaming' can Include the transmission of sports scores, financial news. Ideal 
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news, or other information for display during the watching of nomnal everyday 
live TV programming. 

A further ongoing convergence giving rise to a new class of television 
products offers the consumer the ability to "surf the web" (Internet) through the 
home television set. Set-top products and Internet-ready TVs are enabling 
Internet web surfing and email transmission and reception directly on the TV. In 
this class of product, navigation and selection of options is nonmally achieved by 
using the TV remote control or infra-red keyboard. Web TV is one example of 
this product class and the capabilities and functions achievable. Indeed, a 
modem set-top box has become a true appliance providing a gateway to a 
multitude of services and content accessible through the TV and/or other 
devices, such as PC's, attached to the broadband connection. 

One historical aspect of broadcast radio and television content, namely 
broadcast advertisements, continues to this day. The broadcast distribution of 
advertisements now even extends into the Internet. In fact, much of the new 
conyergenqe and Iritiamet-to-TV services ace supported |jy ady|jrt;is|jig - rahgrig 
fpin typical lhtem<3t:'Style banner ads to full scfe^ii 'rich; medila' VM^d/^Mdlo 

. ,^rtlS(^tS; ^8P:f^eOfi|^S^DKSUCSj;||a^^ 

response or 'MinkiflgMrom the advertlseme^^^ 

hasted by the adyertiser - but only white the user is online ^nd eonnieted to the 
jilrfiet4h:iugh'a 

supjport telephony interactions or voice cdiwi^um<^|ib^ 
Internet connection ties up the telephone line connections. 
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New consumer appliances such as set-top boxes, capable of receiving 
broadband video and data services (over cable, satellite, microwave, etc.). are 
emerging. The ability for consumers to Interact with these services has also 
typically been limited to the receipt and transmission of text or preset auto- 
response data messages - but only when the user is connected to the Internet. 
In these cases too. the data transmitted is not voice telephony, only raw digital 
data. However, telephony is indeed possible directly through set-top box 
appliances, or in some cases using a traditional telephone handset attached to 
the set-top box. 

The present invention seeks to take advantage of the actual capabilities 
of such household electronic products, such as the family television set. 

It is an object of the present invention to provide for the ability to conduct 
a telephone conversation using one's television receiver, set-top box and 
microphone equipped remote control. 

It is a further object of the present invention to provide for the receipt of 
an pn-$cre#ri advertisement having an embedded tel^li1|he numbed 
the iuto-caliback by the user to the advertiser call c^nte^t in real4iffte, 

\tMmM^ the ^sM;in\^n^^ 

reeeived catllback eriabled advertisisnntents to perrifift ttt6 «t$!@f to ^^ew find 
respond to enabled advertisements pfHine. 

Yet anbihei' dbjed of^He presentfiiweritfel^ * ^ r-^^ 

qohtact a live operator and/or a computer system In r^spOftdlng to an 
advertisement response system (ARS) enabled advertisement. 
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Another object of the present invention is to pemnlt the user to engage in 
e-commerce by effecting an order for goods and/or services In responding to a 
received advertisement by transmitting user purchase data. 

These and other object of the present invention will become apparent in 
light the following specification and drawings. 
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SUMMARY OF THE INVENTION 

According to various embodiments of the present invention, an 
advertising and telephony system is enabled by a telephone handset using 
portions of a television receiver and a microphone embedded in a remote 
control. The disclosed embodiments enable new forms of direct marketing and 
advertising. Specifically, advertisements and/or email become interactive and 
enable users to respond immediately and automatically to advertisements 
and/or email messages or other prompts for information by connecting directly 
with a live operator at a call center or to a machine driven server based 
computer system. 

A system according to an embodiment of the present invention enables 
new e-commerce applications by integrating radio or TV, Intemet and telephony 
functionality. The present system enables advertisers to gain significantly 
Increased advertising capabilities through targeted Intemet delivered advertising 
- as opposed to typical broadcast TV ads which reach generic audiences. 
When advertiser$ embed infomiatlon in targeted ads delivered to specific users, 
they can be immediately reached if the user ch^|!es tp Jljltlate the ^tltor 

The present#<iyertisihg response ^^e^^ 
communicattan appliance having ihe abifity to establish telephonic 

^1^3g^Picatl<jrt.t^ Bi6i|^n#|i^r^ 

appflance Includes a central prdbe$sifig uMci^fitrbf meici^. a receh^iir iio^^ 
receiving firom a remote system advertisements Including embedded contact 

5 



4/22/05. EAST Version: 2.0.1 .4 



wo 01/58156 



PCTAJSOl/03435 



information, memory for storing the data representative of embedded contact 
information associated with a raceived advertisement, a graphics engine for 
displaying an advertisements on the television display, and telephone interface 
circuitry for establishing a call over a telephone communication network in 
response to a user command. Telephone control circuitry serves to 
simultaneously place a call over the telephone communication network to the 
advertiser in response to the user selecting an advertisement on the display 
screen. A remote control device permits the user to control the operation of the 
television receiver and command that a telephone connection be established 
between the user and an advertiser whose advertisement is displayed on the 
television screen. The remote control device further includes user input means 
and a microphone whereby the user speaks into the microphone and listens to 
the television speaker to communicate with the advertiser In one embodiment 
of the invention the remote control may be Integrated into a cordless telephone 
handset. 

As dfesgribed, the telephone communicatioh networtc mfiy comprise the 
pub%: switched telephone network or a cortiputer netwoi1< and the r^ote 

VVheri responding to an iad, the teti^^^ 
person at an advertiser service call center or may be diredted to a cdt^uter 
■g^i^fithifi ^ gdyfeiii^erc^ ; Orjl^^p^t ^^^i^^ . p 

provides thit memory served to ^re user purcha^ irilbirrn^fPfiFi^^ be 
transmitted to the advertiser computer system in response to a user command 
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to make a purchase of goods or services from the advertiser. In each case, the 
user command is provided by tiie push of a single button on the remote control 
or cordless handset. 

The embedded contact information Included in the ad may be a phone 
number or an address identifying an advertiser computer server. A storage 
device may store one or more Items of embedded contact Infomnatlon for later 
recall and review by the user toward the user contacting an advertiser offline. 
Not only may the system facilitate the user's immediate response to an and, but 
It may also provide that the user is precluded from establishing telephone 
communication with the advertiser except during specific pre-arranged times. 

A method for pemiitting a television viewer to automatically and 
immediately respond to a displayed advertisement having embedded contact 
information by establishing telephonic communication with the advertiser 
without the user knowing the advertiser's telephone number and without 
requiring use of separate telephone device Is also disclosed. The method 
eomprises the steps of receiving fpr display an advertisei^ent haying embedded 
advertiser contact infomiation; viewing the advertiss^merit 6n a tele>^islbfi 



0[^n «*®te!?tlf>| thattl^^ad^llif ^if|ha^ 0 
indieating td the viewer that the advertiserTOeht m$ #r«feiil^d c#^ 
Informa^'on; extracting the embedded contact inforttiatioh from the displayed 

communication between th6 vfevver and the adverlser, vvhereiy th>e |j|er?i^^ aiilie 
to speak to the advertiser. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 of the drawings is a schematic diagram of a speaker phone 
implemented through a TV using a set-top cable box, a television receiver and a 
microphone embedded in a remote control unit; 

Fig. 2 of the drawings is a block diagram of the telephone functions 
partitioned between the remote control unit and the control processing unit in 
the set-top box; 

Rg. 3 of the drawings is a top plan view of a remote control device 
according to the present invention incorporating a microphone and control 
buttons for auto-dial callback functions; 

Fig. 4 of the drawings illustrates an Internet style banner ad according to 
another embodiment of the present invention illustrating support for auto-dial 

callback functions: 

Fig. 5 of the drawings is a schematic diagram Illustrating the two system 
architectures which support auto-dlal callback, where one connection provides 
voifee telephony to a human operator at a ealt center, and ^e^er provk^^s 
datigtf^nsfnissiph - . ■ 

ast^ts 0f the systfW architecture and iht^fconhectfon te exirrial voiee and 
Mfrtputer systenis; and 

' Fig: 8- of tlte*^a'raiWihg$ is- a?s(*^ri^^^ ;diagr^pf 'IftltliftMllpmppl^v 
of a set-top box according to the present Invention. 
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DETAILED DESCRIPTION OF THE DRAWINGS 

Voice and audio will play an increasingly inDportant role in both 
"traditional" consumer electronics as well as the new convergence appliances. 
Live Internet surfing on the TV requires a connection to the Internet - usually 
either through a telephone connection or cable. However, there are many 
applications which can be supported that do not require the user to be actively 
connected to the Intemet. In those cases, the telephone connection is not used 
and is thus available for supporting telephony applicatidhs embedded in both 
"online" and "offline" applications. 

For example, there are many information services which 'push' content 
and data to the user whereby infonmation is stored in a local appliance, such as 
a set-top box or Internet capable TV, for convenient off-line review. When a 
user has the opportunity to review the information, it may be reviewed while 
disconnected from the Intemet. In these instances, novel, new forms of 
interactivity can be created which allows the user to restct to the information and 
instantly gain a telephone connection to tile infoirtiition sbUrte. 

th^ Drbseht Invention sitso providi^ th#tfe^^ iffifiy re|p&rjd#^ 

provided wherein f he user can irtimediately resipond; to an on-scri|h 

■.$d|^#rtj$^.ment;bx- riiaking a t^«ephG00;:conhectio.n^^^^^^ ^-sA--: 
i^mMimi s^-t# HSiciil Without h^^^ito l^^iii ii<B^^ ' 
the entity being contacted. 
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This present invention utilizes an enhanced wired or wireless remote 
control with an integrated microphone, or alternatively, a cordless telephone 
handset having rennote control functionality integrated therein . It enables a 
new, unique auto-dialing telephone advertisement response system (ARS) to be 
implemented by using parts of a stereo or TV (such as speal<ers). This new 
auto-callbacl< capability achieves a new generation of interactive advertising 
which enables advertisers to establish Instant and direct contact with consumers 
at the consumer's discretion. 

FIG. 1 illustrates a preferred embodiment of the present invention in 
which a speal<erphone telephone function Is provided using a telephony 
equipped consumer appliance (such as a set-top box). The present invention is 
illustrated as including television receiver 10 having a display screen 11 and 
audio speakers 12. Set-top box 13 is shown connected to television 10 by 
connection 19. Set-top box is further shovim connected to the cable service 



provider via connection 18. In one embodiment of the present invention, set-top 
bpX; 13 may also be connected to the public switched tel^^hprie network 




conversation. The remote control 14, eitherwlred or wireless, is iliustrated as 
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including an integrated microphone 20 whicli functions as the telephone 
"mouthpiece". In another embodiment of the present invention the remote 
control comprises a cordless telephone, and in particular, the handset 
component of the cordless telephone. The device may thus resemble a 
conventional cordless handset having remote control buttons positioned on, for 
example, the back side of the handset Special additional buttons may be 
placed on the nomnal telephone side of the handset such as for auto dialback to 
advertisements. In this embodiment the phone handset mouthpiece is the input 
microphone and the TV speaker functionality is optional and may or may not be 
used since there is an earpiece in the phone handset. 

As shown in FIG. 2. telephone processing, including digitization, filtering 
and coding (such as Adaptive Differential Pulse Code Modulation. "ADPCM"). is 
performed in part or in whole by combination of the TV 10 and set-top box 13. 
Both a wired and wireless embodiment is illustrated showing both the remote 
control and set-top box 13 components. As shown, renrote control 14 includes 
a microphone 20. a RF or IR transmitter 22 as well as the associated analbgrto- 
digital converter 26, ADPCM coding device 28, dl|N-to^5inalc)g cbnv^e^ 30, 
#id In me;|#tqp bbx 

converter 26. ADPCM coding device 26, digital-tbr^hiildg (Soriwertfesf S^O^^I^^^^ 
ihtetface 32 which connects to wall Jack 34. A wireless reitiote Conteol 14 

iJMiiilf |ii^|lirft^tivte%^^ 

■ ■.1:.. t.M . 4 

ADPCM coding device 28, D7A 30 and filtefiig anci line infeffac^^f , Af(^rd|ng 
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to alternative embodiments, various devices in the processing path may be 
incorporated into remote 14. 

The audio output circuitry includes gain control and drivers to: 1 ) send 
signals out to mono or stereo consumer electronics audio cables; 2) send audio 
out to standalone spealcers; 3) output baseband audio; 4) send audio output for 
processing to modulate and insert the audio into a video carrier (such as NTSC, 
PAL and SECAM) for playback through a TV on a modulated TV channel. 

FIG. 3 illustrates a remote control 14 according to one embodiment of the 
present invention. Audio output circuitry is integrated Into the wired or wireless 
consumer electronics remote control 14 (such as the type used to control a TV, 
VCR or stereo) together with a microphone 20 to acquire voice input. The audio 
input circuits associated with microphone 20 may include digitalization, voice 
coding, voice compression or voice recognition, or may merely pass an analog 
voice signal to set-top box 13 for processing. Audio input may be any fonm of 
audio input including, but not limited to, voice, music, instmments, etc. In the 
context of the present invention, the audio Input will typij^tly Gomprfee the 
user's voice. In the aiustiated embodiment, rprfKi?? cpptripl 14 in^^|^ 
'.M#l«i-:CQhti*»l^buttbil^ii 

emm control button 43. ad response callback bui0n;44/|tety b«itii^i^ 45', 
microphone on button 46, cursor control button maitirix 47, keypad 48v and clodk 
■aftd^ii'^ilttons 4^-^and:50i \n ihe^etiMdiM 

is a wireless device, however, it may be implenfehted ^s a wired devlci without 
departing from the scope of the Invention. 
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According to the present invention, the automatic dialing function is 
initiated from the remote control by push of a single button on remote 14. The 
remote control 14 can initiate an auto-callbacl« telephone function when a user 
wishes to respond to an advertisement or email appear on screen. Upon 
hearing, seeing or reading an auto-callback enabled advertisement or email, the 
user may depress a single button 44 on the remote control 14 which initiates the 
set-top box appliance processing unit to establish a telephone call to the 
advertiser either via cable or the PSTN. The user may then directly engage in 
communication with the sending advertiser or email author to talk, colled 
infomiation, or conduct a transaction. According to this aspect of the invention 
the user does not require a separate telephone and does not have to retrieve 
paper and pencil to write down a response telephone number which appears on 
or in the ad, and instead can react to an ad or email Immediately. In fact, as 
described herein, the user need not even know the telephone number of the 
person being contacted. This single button callback also applies to non-voice 
telfiiphony auto-cdilback applications where the user's ap^llsince may call an 
adw^rliser's cornputing systefn to place an ele^rohlc off w|ire the a^^jllance 

riit«i»^?lief?^.^^^ 
ah eiediohie Oia#^ wi4n 

According to the present inVentionr teleiphorie num|6^^^ ^re efilfe^jcled as 

:%iiti!^M^^t^^ 

b^^rhbeddad ih the header section of ah" email d^'^p^ ne^^^^ 

illustrated, advertisements 61 may take the fornl of static images containing text 
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and graphics. These advertisements include an embedded callbacl( number 
and may or may not display the telephone number 62. In each case the 
telephone number is Included In a pre-defined stream of digital information 
forming a portion of the advertisement being displayed and is extracted from the 
data stream by the set-top box processing unit Icon 60 In the advertisement 
notifies the user that the ad being viewed is auto callbadt enabled. This 
callback number may be stored and used whenever the user elects to initiate a 
callback function. The embedded phone number thus provides a system 
whereby consumers can immediately and impulsively respond to 
advertisements and emails without leaving their surroundings and can establish 
a direct telephone link with the sender. 

Another embodiment shown in Fig. 5 illustrates the capability to callback 
to a person. In this case, the system connects the user with an operator or 
employee in a call center 70 for the company which placed the advertisement 
over a voice connection 72 between set-top box 13 and the operator. An 
altemate embQdi(t»ent shown in Fig. 5 includes the eap|bifify to callback to a 
server 71. as oppQSed to a person. lri thisxase, Jie s5^§^ Q9hp^^^ 
.,$0iver 7i; ^hd auteN^^iiy sends ' 
correlated to an advertising event over a data tohhedtfelii^l bi#^6n*^b^^ 
and server 71 . For example, pre-stored infbmnation could Include 
^ nirne, tddress-and the d^t^" and-tim^." ^frtt^^^^ 
used to reference a database containing the user's pt®fei^ credit^ear^ 
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Information. The date and time can be used to correlate with an ad that is being 
presented to the user. 

Another embodiment enabling auto-callback uses pre-arranged, pre- 
stored data which Is not embedded In an advertisement. According to this 
embodiment telephone numbers are pre-stored in the set-top box appliance and 
are used in the automatic response system in applications which are not 
specifically associated with advertisements or Internet e-Commerce. One 
example Includes home shopping channels and other special broadcast 
advertisements. These channels initially send the user's Internet TV or set-top 
box appliance a pre-determlned number. The user may configure the box to 
associate this number with a particular memory location and/or remote control 
button. Accordingly, this number may be activated and thus dialed by pushing a 
programmable button on the remote control 14. such a dedicated button for the 
home shopping channel. 

In a still further embodiment of the present Invention a specific callback 
number can be set up to bedctive only during speoKle tirnps and dates. For 
example, a special number may be reserved j^r use Qj^ durii^g^hall^ Of a 

fobfl^Bpitie. ThiSjrter^Vii>»^^^ • 
appliance.(suehasanlntemetTV0rset>topbox)i^ i*^td 

be activated only during tfie specific timers). 

Addltlonaily it1s,;G6rfernpl^ilhi,liiiir|li4 
stored in the set-top box for offline review ahdmi thereby creating a perisonal 
ad file. A user may thus review the stored callback-capable advertisements. 
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scrolling through them, much as one might review phone book yellow pages. 
The user may thus select and activate an callback-capable advertisement at 
any time. The response may be to establish a voice connection or a data 
transmission. 

In a first example of the operation of the present invention a user is 
viewing a broadcast television program such as a football game. A user may 
choose to make a phone call during the program to, for example, speak with a 
friend about how their favorite team is performing. ^The present invention 
enables the user to place a call and conduct a normal telephone conversation 
using the remote control to receive the calling party's voice and the television 
speaker or a speaker integral to the set-top box appliance to hear the called 
party's voice during the call. If the TV speakers are used the user cannot listen 
to the television broadcast while conducting a telephone conversation. 

In a second example a user may respond in real time to an 
advertisement which appears on the TV screen. A particular advertisement 
displayed on a TV or transmitted over a radio chanfliel. in rea| time* luay prove 
intere$ting to the listenen The moment the JIiSterjerhgiars #»e f d the listener 
.. u$mm |3*#s$«*tJnvShtiph:h^^ y!|i>-i^Fi^:i|&|fe.p 

the remote coritroi to automatibally tefepliona the coml^any The 
user may then engage In a nomlal telephone conversatlori witft-th^ advertising 
.campa«j?i.-;<5|n:«efvice c#iter to-ft^t|i#rea^f^ail)|!a#^^ 
featured in the ad. order the product 6f service; or provide othfer feedlack. In 



16 



4/22/05, EAST Version: 2.0.1 .4 



PCT/US01/0343S 

WO 01/58156 

such cases, the callback telephone number is already pre-arranged and pre- 
stored In the processing unit of the set-top box appliance. 

In a third example of the present invention, a user may respond off-line to 
an embedded internet style ad. Advertisements can be normal broadcast ads 
(such as TV commercials) or embedded ads which may be pre-stored in a 
device connected to the TV (such as an Internet-TV or set-top box). For 
example, web pages, email, or other infomnation may be stored In a set-top box 
appliance for convenient leisurely offline review by a user. When the user 
reviews the information, there may be ads with embedded data which the user 
could select for auto-dial connection to the advertising company. 

For example, a nationwide pizza chain may choose to use this system to 
send advertisements for home delivery of pizzas. The distributed ads. 
embedded in user Information services such an email or newsletter, may 
contain embedded data comprising the appropriate phone number for a local 
pizza outlet. Thus, wherever the user is located, if they so decide, the user can 
order a pizza by using the sy^em to auto-dial ihelr outlet and speak 

to a person to place an order. , 

■^■Aut6rriatiGl©sp6ri?^^^t^ 
^rgeted^dvertlsflhg, of My sImpiy ciiH ^ 
syst^iti enables users to directly telephone back the;^ender of the ettiail if the 



'v >Mis-^Ofe&ed. i%re)|rtii^iil#^#iMlMiWi^^ 
according to the present system so Jhe r^^^^^^ is ¥m6dijra|ed1o 
immediately call the sender when the email is received. 
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A fourth example provides for the automatic cailbacl< to a server, as 
opposed to a human. Either real time or stored advertising can be responded to 
with a data transmission from the home appliance (TV, stereo, PC or set-top 
box). For example, a user may see an ad for a new CD just released. The user 
could push a single button on the remote control and cause the system to auto- 
dial the advertiser and send previously stored Infomiation to the advertiser's 
computing center to thereby place an order for the purchase of the CD, This 
Information is an^nged to effect the purchase transastion whereby the user 
buys the advertised CD by a simple single button push on a remote control. 

In a fifth example the callback feature of the present invention may be 
used to respond to surveys. Surveys may be sent to users through an Internet- 
type appliance such as a set-top box. Users may choose to reply to the sun^ey 
request by initiating the auto-callback function of the present invention and 
speak directly w'rth the marketer, be it a person or computerized voice 
synthesized system. 

In a sixth example, a us#r may be watGhing a Noltte sHoppihg ehaiinel on 
TV. When the u^f wishes to purcha$j&|iriii^i*^^ 
»eedS to push a'UhgJe.buttGin-ari tfte t^ftifitS.CM^i^^ 
feature using a pre-artanged pre-stored callb^Mk humbif. f he uiH" 18 thus 
connected, as on a telephone, to the se^e? 



simply delivers user infomnation to effect the piunfehase. 



fennel, : this^itiay also bepple^^iilfi 

■4 -tL 
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Each of foregoing examples illustrates a novel feature of the Invention 
wherein the user via a remote control together with the TV speakers can 
engage In telephone communication without the use of a conventional 
telephone set. Alternatively, users may engage the novel telephone dial-back 
capability using a combination telephone handset and remote control. 

The present invention thus further affords a superior level of convenience 
and control for the consumer. For example, the user may choose to ignore the 

interactive callback ads, or may respond if desired without moving from their 

> 

current location. The present Invention eliminates the need to memorize or 
write down callback numt)ers as well as the need to go and retrieve a telephone 
to respond to an ad. 

According to one embodiment of the present invention illustrated in Figs. 
6 and 7. the appliance 13 transmits voice and user infomnation simultaneously 
so that the user can use the appliance's telephone function to speak with an 
advertiser's representative while the representative's computer simultaneously 
communicates with the user's applia|tce. Accprciirkg to,| pr|f$rred eri!)boc|pr|tent 
bf the inyentioh, advertisements broadcast to .^h& cbnsumer ifteljjds erftb^i^^^ 
odn^et ti^aifi^n - irw^ludirig a^l^^T^^^J^f^^^p^^^^^^^ 
artd ah addyess forthe adV^rtl|i^i*l co^uter lj^^ii. ^ti^^l^F^^eiSi®* 
is displayed, the user may selisct the ad with thd remote 0hti;£lt. The appljarice 
■ In tuiri- con~ile.ets:ttie useRtb.^- serverpvfer.f ^tel^l^^^ 
81 and 62 can be voice-over IP. IP telephony, a fS^pfrietli^ prbtdcOl, 6ho|h^^ 
suitable protocol. 
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The appliance 13 transmits the advertiser contact infonnation to the 
server 80. The server 80 uses the contact information to make two separate 
connections, a telephone connection 84 to the advertiser's call center 87, and a 
computer connection 85 to the advertiser's computer system. 

Tlie server is shown as including a modem 90, for example a V.42 
modem, to separate the voice data and user information from the appliance. 
The server makes a telephone connection over a normal PSTN connection 84. 
Alternatively, the server can utilize internet telephony, using a voice codec 91 to 
convert the data Into data packets for transmission over a network layer 86 
using TCP/IP protocol to communicate with the call center 87 via the Internet. 
Processor 93 connects to the advertiser's computer network over a regular 
computer network connection 92 such as the internet 94. 

During this connection, the user speaks with the advertiser 
representative at call center 87 regarding a product or purchase, and the 
representative using a PC 88 can transmit text and/or graphical Information to 
the user's appliance 1 3 for displiay. The Informfition trf fisrhitted may orif iwate 
from the representative's PC 88 or server systdni, or ^%M rem6\i&d.frtirjn pre- 

■ st^ ii^foiTriaitto«~m4»B- netwiHtf^ii --^^^ t::v4 f 

F^r eicampie, arl ad a^^^^ 
television screen, and the user decides (s)he wolElikeio jslan a'^tiip to Havyaii. 

^■;rlme.u^^»i^cts the.adve:rtis^:iit ■■ ■■. 

automaticaily makes sirTitiltaneoUs t^Iephli^ie arid c6mputer.c^ to m6 
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agency's call center and computer network, respectively, using the embedded 
contact information in the advertisement. 

While the user speaks with the travel agent, the travel agent is able to 
transmit useful information back to the user's appliance via the computer 
network connection to assist in the transaction. This infbmiation could include, 
for example, a list of available flights from the local eirport(s), a photograph of a 
hotel, and a map of the island indicating the location of the hotel. 

While the foregoing examples primarily address the use of the present 
invention in association with advertising, it also has utility when used in 
association with ennail that may be received and viewed on a TV. 

According to an embodiment of the invention, the appliance receives 
email messages from an internet connection established by the set-top box 
appliance, or the cable service provider who In turn transmits the email to the 
box in the user's home for display on the television screen. The user thus may 
browse the stored email offline. Data representative of the sender's telephone 
number may b6 fonmatied into the email message. Tftfe appjiaftce thus ^jetracts 
and converts this data and autbmatlcally dla^s the t(i||iDh^fie riufli|war lr> 
r6s|@h?i t6:^;M§fer C50rnmand.i^^ 

button on the remote while in the eiiiail rnode! If a iel#ii«irt|*i)0 is 
detected in ttie email, the appliance displays an alert ii|o^5.on the; scr^eh 




environment. 
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Email messages are sent over networks using email protocx)ls such as 
SMTP, IMAP and P0P3. Email messages contain header portions that include 
routing information and a body that contains the text of the message. The 
information In the header is used by the email system software to route the 
email message between the sender and the recipient. According to this 
embodiment the telephone number of the email sender is embedded directly 
into the header of the email message in a prescribed location and/or manner 
such as a specific character sequence which either or both precedes or 
postcodes the actual telephone number. Alternatively, the data representative 
of the telephone is formatted in a data block in a prescribed location not in the 
header, but a flag or other indicia is contained in the header Indicating that the 
email message contains such a data block. 

Software applications are known that search the text of email messages 
for number strings that resemble telephone numbers and then use those 
number to place a telephone call. However, these applications are prone to 
en^ors. They may erroneously identify number strings th^^ 
numbers. Furthenmore. they are relatively sipyv: because they m^M^^ 
th^ugHthe entire qdnteft of tl^^ 

improveriient over such applications. It is faster ahtl ttBiB BG0t$W becaMs6 ho 
scanning is necessary since the telephone number iSf^lWjpys iri tfie same place 
i Ih ihe 6maii we^^g^ 
character sequence. 
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The user may conflgtre his or her screen interface to utilize the extracted 
telephone number according to the user's preferences. The user may configure 
the interface to automatically dial a telephone number extracted from the 
header upon opening the email message, or altematively, only dial the number 
when the telephone button is pressed. When creating messages or responding 
to sent messages, the user may configure the system to automatically embed 
the user's telephone number in the header of the outgoing email message. 

The present embodiment is especially useful for entities that advertise on 
the internet using email messages because the user can automatically 
telephone the advertiser's call center upon opening the email advertisement. 

Software agents and robots (also known as bots, spiders, and 
metacrawlers) allow individuals to search content on the Internet for Information 
of particular interest. According to one embodiment, the user Instructs a robot 
to find a desired item for purchase on the internet. The robot locates the web 
sites of retailers that offer the item, copies the telephone number frt)m the web 
site, creates a notice email addressed to the user, and fomtiatd the retailer's 
telephdrie number in the header of the email. Whfen thd user oisehs the emaH. 
(g)he can instrucl the apfaiahee to Cj^l Jie ii^aprM||r!n|a^ 
environment and place an order for the desired Item. 

F;g.B of the drawings is a schematic diagram of the intenial c^iripcHtents 
• of a set-tdj^ixMc acGoKling to the pr^ei||lhveiif^'^^ 
box 13 includes a modem 100 acceptirtg^vbice and data cohnectidhs 107 ^nd 
108 to the cable operator. Microprocessor and memory 102 serves to control 
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the overall operation of the unit including codec 101 , graphics engine and mux 
103. Output 105 provides an audio output to the audio speakers of the 
television while output 106 pnsvides a video output to the television screen. 

The present embodiment may be implemented in other environments 
commonly used for email correspondence such as a personal computer or a 
portable device such as a portable PC, hand-held computers and organizers, 
and mobile phones with email paging capabilities. An example of such an 
embodiment is for mobile phones with email receive capability to either 
automatically or upon user command dial-back to the sender of an email. 

It is envisioned that the embodiments of the present invention may be 
implemented in hardvyare or software, or a combination of both (e.g., 
programmable logic anrays). Unless pthenwise specified, the algorithms included 
as part of the inventton are not inherently related to any particular computer or 
other apparatus. In particular, various general purpose machines may be used 
with programs written in accordance with the teachings known to those in the 
?irt, or it may be more convenient to construct more speiSlaiized apparatus to 
perform the required method steps. However, preferab^^, the invrentipn is 
Irfiptemarited in 6he or worej^mputerprog^ama 
systems each comprising at least one ^toca^sdr, at l^llSt larii 4^M st0i^$ 
system (including volatile and non-volatile memory and/or storage elements), at 
. JefBt pnein|jW device^ and at le^ttin^^buplfefce-^^^ 
to input dat^ to perform the functions dascriM herein and genera^er outpiit 
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information. The output information is applied to one or more output devices, in 
know fashion. 

Each such program may be implemented in any desired computer 
language (including machine, assembly, high level procedural, or object 
oriented programming languages) to communicate with a computer system. In 
any case, the language may be a compiled or interpreted language. 

Each such computer program is preferably stored on a storage media or 
device (e.g., ROM, CD-ROM, or magnetic or optical media) readable by a 
general or special purpose programmable computer, for configuring and 
operating the computer when the storage media or device is read by the 
computer to perform the procedures described herein. The inventive system 
may also be considered to be implemented as a computer-readable storage 
medium, configured with a computer program, where the storage medium so 
configured causes a computer to operate in a specific and predefined manner to 
perform the functions described herein. 

The foregoing description and drawings aiB meriily tb explain and 
iliustrate the invention, ar)d the invention Is not limited Ihereto exisept Insofar as 
the ind^psrident cl^lm^are so liftilted^ ^^P^lf^f^ 
disclosure before ttiem will be afete to make n^ifiGaiiwI #d 0rMt\ 
without departing from the scajpe of the Invention. 

■; . . ' " : .'^.j^^ ^ . , ^ W' 
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What is Claimed is: 

1 . An advertising response system for use with a television receiver 
including a display screen, a speaker; and a remote control including a user 
input means and a microphone; and a communication appliance operably 
connected to the television receiver and the remote control; the advertising 
response system comprising: 

- a central processing unit, 

- means for receiving data representative of advertisements from a 
networked computer system, 

-means for storing the data representative of advertisements and 
containing data representative of a telephone number of a particular advertiser 
and an address of the particular advertiser's computer, 

- means for displaying at least one of said advertisements on the display 
screen, 

- means for placing a call over a telephone network in response to a user 
command, 



. means for receiving a first audio siisilffer^ 




- means for transmitting said first audio signal ever the l^H^m nitwefk 





' -ijeansfor;re#ivirg-iks ifi 



and outputting the second audio signal thrdugh the speal<er during a call, 



- means for storing user purchase information, and 
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- means for simultaneously placing a call over the telephone network to 
the advertiser and connecting to the advertiser computer over the computer 
network in response to the user selecting an advertisement on the display 
screen. 

2. An advertising response system for use with a television receiver 
including a display screen, a speaker; a remote control including a user input 
means and a microphone wherein the television receiver is connected to a 
communication appliance; the advertising response system comprising: 

- a communication appliance connected to the television receiver and a 
remote computer system, having the ability to establish a telephone 
communication link, the communication device including a central processing 
unit, control nneans, a receiver for receiving data representative of 
advertisements from a remote computer system, memory for storing data 
representative of a telephone number of a particular advertiser and an address 
of the particular advertiser's coniputer, 

graphics engine^fbf displaying at^l|is^ 

telephone int^^face clreulti^^# fatfeirig a tetiijio'n^^ 
Conrtmunlcatien networtc In reisTpcfftse to a u$0r fcd^^lhi^fd, 

toiudiosi^ha^^^^^^^^ 
microphone of the renrate contmty 
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audio signal transmitter for transmitting said first audio signal over 
the telephone network during the call, 

second audio signal receiver for receiving a audio voice signal 
from the telephone network and outputting the signal through the 
speaker during a call, 

control circuitry for simultaneously placing a call over the 
communication network to the advertiser and connecting to the advertiser 
computer over the computer network in response to the user selecting an 
advertisement on the display screen. 

3. The invention according to claim 2 further including memory for storing 
user purchase information which may be transmitted to the advertiser computer 
system in response to a user command to make a purchase. 

4. The invention according to daim 2 wherein the communication network 
GJompiises the public switched telephone netvvdrtc. 



establish a telephone call to an advertiser whose displayed advertisement. 





Gofnprises the Memet 
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having embedded contact infomnation, is received by the system and displayed 
on the television screen, the advertising response system comprising: 

- a communication appliance having the ability to establish telephonic 
communication to between the user and the advertiser, the communication 
device Including: 

central processing unit. 

control means. 

receiver for receiving from a remote system advertisements 
including embedded contact information, 

menriory for storing the data representative of embedded contact 
information associated with a received advertisement, 

graphics engine for displaying an advertisements on the television 
display, 

telephone interface circuitry for establishing a call over a 
telephone communication network In response to a user command, 

tel0p^dne control citeuftry fdr simultahe@[u|(t^||la^ oyer 
the telephone comniunlcatlon network to tHe Mvertl^er in rBSbaftss to 
,tb#us§r:s^l^ '^''f 
- a re^ndte odftitiol device fdr permjiifig till ^SfeKiA^ 
of the television receiver and command that a telephone cof:ini^pn%e 

displayetd on the television screen; the rertriote control ^gV46fe^^.f^ 
user input means and a microphone whereby the user speaks into the 
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microphone and listens to the television speaker to communicate with the 
advertiser. 

7. The invention according to claim 6 wherein the telephone 
communication network comprises the public switched telephone network. 

8. The invention according to claim 6 wherein the telephone 
communication network comprises a computer network over which telephone 
calls are connected. 

9. The invention according to claim 6 wherein the remote system 
comprises a cable television provider network. 

1 0. The invention according to dalm 8 wherein the computer networic 
comprises the Internet. 

t1 . Thi& invjintiorj according to claim .8 vvt)Br^|i the <^ 



^ ■■' ■' / :■■}■'■■ . ...... 




12. The irivention according to claim 6 wherein the tfeli|?hon6 ca^pis direxited 
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13. The Invention accordirg to claim 6 wherein the telephone call Is directed 
to a computer server within an advertiser computer system. 

14. The invention according to claim 6 further Including memory for storing 
user purchase information which may be transmitted to the advertiser computer 
system in response to a user command to malce a purchase of goods or 
services from the advertiser. 

15. The invention according to claim 6 wherein the user command is 
provided by a single button on the remote control. 

16. The invention according to claim 6 wherein the embedded contact 
information comprises a telephone number. 

1 7. The invention according to daim 6 wherein the embedded contact 
infortnatioh comprises an addres^ ident^ing an adv^rti^r cdmputi^r serv^ 

.l''v. ■ ' /\ f 8, T^ijfivent|ari^ajpcp ■ ■ 

: ^ngoneormorertemsdfenrilje^ 

review by the user toward the user contactihg an advertiser offUme. 

19- fhd Invention acc*)rdinfii to dainrt ' 
provided by a single button on the remote control. 

31 

4/22/05, EAST Version: 2.0.1 .4 



wo 01/58156 



PCT/USOl/03433 



20. The invention according to daim 6 wherein the embedded contact 
Infomiation includes data elements which prevent the user from establishing 
telephone communication with the advertiser except during specific pre- 
anranged times. 

21 . A method for permitting a television viewer to automatically and 
immediately respond to a displayed advertisement having embedded contact 
information by establishing telephonic communication with the advertiser 
without the user Icnowing the advertiser's telephone number and without 
requiring use of separate telephone device, the method comprising: 

- receiving for display an advertisement having embedded advertiser 
contact information; 

- viewing the advertisement on a television display; 

- detecting that the advertisement has embedded contact information; 

- indicating to the viewer that the advortiseme^t has embedded contact 
infomriation; 

advertisement; 

- establishing at the user's command a teleph^i^ iooriifriitii^k^ 
between tH^ vifew^^rand thd>iid^^rtiser %^^h^L;>':-:;-.-'' : 

- whereby the user is able to speak to the adverSser. 
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22. The invention according to claim 21 wherein the command to establish a 
telephone connection between the viewer and the advertiser is given by the 
user's push of a single button on the remote control. 

23. The invention according to claim 21 wherein the step of establishing a 
telephone connection between the viewer and the advertiser in response to the 
command establishes telephonic communication with a live person at an service 
call center. 

24 The invention according to claim 21 wherein the step of establishing a 
telephone connection between the viewer and the advertiser in response to the 
command establishes telephonic communication with a server at an advertiser 
computer network. x 

25 The invention according to daim 21 wherein the method further includes 
the step of storing the extracted contact infonnation for later review by the user 
and Offline communication between the vieper and the adyerttser. 

26 The invention according to dalm 21 vi^fein the inv^hti<;m filftilr 
includes the step of retrieving stored contact infonmation toward estabHshing 



telfeptipnic eonnirnunteation wit^^^^ advertiser. 
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27 The invention according to dalm 21 wherein the step of indicating to the 
viewer that the view can immediately establish telephone communication with 
an advertiser comprises the step of displaying an icon on the television screen. 

28. A advertising response system Including a television having a display 
screen, a speaker, a remote control including a input means and a microphone, 
a communicatfon appliance operably connected to the remote control, the 
television, and the speaker, the advertising response system comprising: 

- a central processing unit, 

- storage meanSp 

- means for receiving data representative of advertisement from a 
networked computer system, 

- means for storing the data representative of advertisements, 

- means for displaying at least one of the said advertisements on the 
display screen, 

- njeanis for placing a call over a telephone network in response to a user 
cdmrffiand, 

^ means for repelying a fimt audio sigft# ovirlha 
dariHi the imfti 

- means for receiving a audk) voice signal from the ti^e»phbrie network 
an^ piit^king the signarthrougMhe^S u " 
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- means for receiving an email message over the networked computer 
system, said email message comprising data representative of the sender's 
telephone number in a header porticn of the email message, 

- means for extracting the telephone number from the email header 
portion, and 

- means for using the telephone number to place a call in response to a 
user command. 
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